Action and actor gaze mismatch effects during spoken sentence processing

نویسندگان

  • Dato Abashidze
  • Pia Knoeferle
چکیده

Eye tracking research on situated language comprehension has shown that participants rely more on a recent event than on a plausible future event during spoken sentence comprehension. When people saw a recent action event and then they listened to a German (NP1-Verb-Adv-NP2) past or futuric present tense sentence, they preferentially looked at the recent event target over another plausible target object (that might be involved in a future action) independent of tense. This preferential inspection persisted even when future events and futuric present sentences were much more frequent within the experiment, or when a gaze cue biased towards the future action target. The present experiments extend this line of research by introducing incongruence (in Experiment 1 a past tense verb mismatched the recently seen action and in Experiment 2 an actor gaze cue mismatched the past tense sentence condition). Can the verb-action and the gaze-sentence mismatches eliminate the recent-event inspection preference? Would participants recall information in post-experimental memory tests better for matches (the futuric present tense condition) than mismatches (the past tense condition)? Results revealed inspection of the recent event target as participants processed the verb-action mismatch (Exp 1) and actor gaze incongruence (Exp 2). However, the gaze (but not the verb-action) incongruence eliminated the overall recent event preference in the NP2 region. The memory tests also showed some evidence for a reversal of the recent-event preference.

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Incremental Effects of Mismatch during Picture-Sentence Integration: Evidence from Eye-tracking

A model of sentence-picture integration developed by Carpenter and Just (1975) predicts that picturesentence integration ease/difficulty depends on picturesentence match/mismatch respectively. Recent findings by Underwood, Jebbet, and Roberts (2004), however, fail to find a match/mismatch difference for serial picture-sentence presentation in a sentence verification study. In a sentence compreh...

متن کامل

Peripheral speaker gaze facilitates spoken language comprehension: Syntactic structuring and thematic role assignment in German

A speaker’s gaze reliably precedes her reference to an object. This consistent link can permit a listener who frontally faces the speaker to inspect the upcoming referent before its mention. It is unclear whether this listener benefit is pervasive even across different sentence structures and when speaker and listener don’t face each other directly. A video-taped speaker seated at an angle rela...

متن کامل

Effects of speaker gaze on spoken language comprehension: task matters

Listeners can use speakers’ gaze to anticipate upcoming referents. We examined whether this listener benefit is affected by different comprehension subtasks. A video-taped speaker referred to depicted characters, using either a subject-verb-object or a non-canonical object-verb-subject German sentence. She shifted gaze once from the pre-verbal to the post-verbal referent, a behavior that could ...

متن کامل

Can Speaker Gaze Modulate Syntactic Structuring and Thematic Role Assignment during Spoken Sentence Comprehension?

During comprehension, a listener can rapidly follow a frontally seated speaker's gaze to an object before its mention, a behavior which can shorten latencies in speeded sentence verification. However, the robustness of gaze-following, its interaction with core comprehension processes such as syntactic structuring, and the persistence of its effects are unclear. In two "visual-world" eye-trackin...

متن کامل

Different mechanisms for role relations versus verb-action congruence effects: evidence from ERPs in picture-sentence verification.

Extant accounts of visually situated language processing do make general predictions about visual context effects on incremental sentence comprehension; these, however, are not sufficiently detailed to accommodate potentially different visual context effects (such as a scene-sentence mismatch based on actions versus thematic role relations, e.g., (Altmann & Kamide, 2007; Knoeferle & Crocker, 20...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2017